RESTRICTIVE COSTS IN NETWORK SYSTEMS 



Claim for Priority 

The application claims priority from EP Application No. 00810075.2 , filed on January 
27, 2000, which is hereby incorporated by reference as if fully set forth herein. 

Field of the Invention 

This invention relates generally to restrictive costs in network systems. Particular 
embodiments of the invention provide methods and apparatus for generating restrictive costs for 
directional paths between nodes in a network system. 

Background of the Invention 

In general in data communications networks, network devices such as switches, routers, 
bridges, brouters, etc. constitute nodes of the network and are interconnected by Unks for 
communication of data between the nodes. Data communications, or "calls", between a sending 
node and a receiving node are routed over paths in the network structure which may involve 
multiple nodes and links. Information about the network topology is required to determine call 
paths, and the nature of this topology information, and how it is used, are important factors in 
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the overall efficiency of the system. Network systems, which may comprise a single network or 
an internetwork, commonly employ some form of hierarchical or multi-layer model whereby 
nodes at the network layer are grouped in some way, and detailed information about the 
topology within the group is not available to nodes outside the group. As a simple example, in 
5 the case of an internetwork with multiple interconnected networks, detailed information about 
the topology within a given one of the networks may not be available to the other networks. 
Thus each individual network can be considered as a group of nodes for which detailed 
J topology information is not available outside the group. A more complex example is provided 

f by PNNI (Private Network-to-Network Interface) networks. The PNNI protocol will be 

■"^^ 

't 10 discussed in detail below. Briefly, however, a multi-layer model is employed whereby nodes at 

3 the network layer are grouped to form "peer groups". One node in each peer group is 

designated "peer group leader" and serves to represent the peer group as a single logical node 
T (a "logical group node" or LGN) in the next layer up of the hierarchy. The nodes in this next 

layer are similarly grouped into peer groups each of which is represented as a single node in the 
15 next layer, and so on. The detailed topology of each peer group is known only to nodes within 

that peer group. Nodes outside that peer group see the peer group abstracted as a logical 

group node. A PNNI peer group thus provides another example of a group of nodes (which 



CH919990050US1 



-2- 




may themselves be logical group nodes in this case) for which detailed topology information 
about the group is not available outside the group. 

The topology data required for path selection and routing in a network system may 
include not only details of the layout of nodes and links but also certain "quality of service" 
5 parameters. For example, a call to be routed over a network may require a certain bandwidth. 
In this case, knowledge of the bandwidth of links in the network is required to determine if the 
call can be connected successfully. To allow such parameters to be taken into account, "costs" 
can be associated with links and paths in a network. The cost of a link is expressed as an 
arbitrary value determined as some function of the parameter, eg., bandwidth, about which 

10 knowledge is required. Whatever the particular function employed, according to convention it is 
usual for the cost to be defined such that the lower the cost the better the link. In the case of 
bandwidth, for example, the cost C of a link may be defined as C = 1/bandwidth. A path in a 
network, involving multiple links, can be measiared by a "restrictive cost". According to the 
definition of restrictive cost, the weakest link in a path defines the restrictive cost of the path. 

15 Thus, when convention is followed such that a higher cost corresponds to a weaker link, the 

restrictive cost of a path will be determined by the maximum of the costs of the constituent links. 

The concept of restrictive cost is useful wherever it is necessary to determine whether a 
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call can traverse a given routing domain for a specified cost While individual links in a network 
may have associated costs, the examples of hierarchical systems described above demonstrate 
that the details of these individual links may not be known throughout the whole network system 
over which calls are routed. In particular, where there is some group of nodes for which 
detailed topology information is not available outside the group, it may be necessary to 
determine whether a call can traverse that group of nodes for a specified cost. In such cases, 
the necessary information can be provided by a set of restrictive costs, for example in the form 
of a cost matrix, defining the restrictive cost of paths traversing the group. More specifically, 
where the group has a number of "border nodes" which are connected by links to nodes outside 
the group, a set of restrictive costs for the group can include the restrictive costs of the paths 
between the border nodes. This information can then be used to determine if a given call can be 
routed across the group for the required cost. There may of course be more than one path 
between a given pair of border nodes. In this case it is desirable to give the restrictive cost of 
the best path, ie. that with the lowest restrictive cost. Moreover, costs associated with links 
and paths can be directional. That is, there may be a particular cost associated with traversing a 
given link/path in each direction. In effect, therefore, a given link can be considered as a pair of 
oppositely-directed, unidirectional links each of which has an associated cost, and the cost can 
be different for the two directions. Such costs are said to be "asymmetric". To avoid loss of 
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information, it is desirable for such asymmetric costs to be taken into account in deriving the 
restrictive cost set for a group of nodes, so that the restrictive costs are given for directional 
paths in both directions between the required nodes. The problem is how to efficiently derive 
the required set of restrictive costs for a given group of nodes. 

The problem is in some ways similar to the class of problems known as "finding all pairs 
of shortest paths". Algorithms which address this are discussed by T. H. Cormen, C. E. 
Leiserson and R. L. Rivest in "Introduction to Algorithms", The MTT Press, 1989, particular 
examples being the Hoyd-Warshall algorithm and Johnson's algorithm. These algorithms 
compute optimal paths between all node pairs represented by vertices in a graph. The 
complexity of these algorithms is no lower than 0(neLog e) (with Johnson's algorithm for 
sparse graphs), and usually O(n^) (Floyd- Warshall algorithm), where n is the number of vertices 
in the graph and e is the number of edges in the graph. 

In order to compute a cost matrix using traditional routing algorithms such as those of 
Dijkstra, Bellman-Ford or Floyd- Warshall as mentioned above, usually 0{n^) steps are needed 
where n is the number of nodes in the network. As already noted, however, the purpose of 
these algorithms is to compute a path through a network rather than generate a cost matrix. Our 
copending European patent application No. 981 14966.9, filed 10 August 1998, discloses a 



CH919990050US1 



-5- 



method for generating a restrictive cost matrix using a graph coloring technique. This method is 
also discussed in 'Transition Matrix Generation for Complex Node Representations", I. Diadis 
& P. Scotton, IEEE ATM Workshop, Kochi City, Japan, May 27, 1999. This method is 
based on the minimum spanning tree growth suggested by the Kruskal and Prim algorithms 
discussed in the publication of T. H. Cormen mentioned above. The basic principle is to add to 
a spanning tree (or spanning forest) the safest possible edge at each step. This ensures that, at 
each step of its growth, the spanning tree (or forest) is minimal. The method employed requires 
costs to be symmetrical. That is, the cost of a given link is taken to be the same in both 
directions so that, in effect, only one cost is associated with a given link/path regardless of 
direction. 

Summary of the Invention 

According to one aspect of the present invention there is provided a method of 
generating a set of restrictive costs associated with directional paths between selected nodes in 
a group of nodes of a network system wherein each node in the group is connected by a link to 
at least one other node in the group, and each link has a pair of directional costs associated 
therewith such that each link can be considered as a pair of oppositely-directed, unidirectional 
links each of which extends fix)m a source node to a destination node and has a said directional 
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cost associated therewith. The method comprises the steps of: 

(a) assigning a imique identifier to each of the selected nodes; 

(b) selecting said unidirectional links in order of cost; 

(c) for each unidirectional link selected, if a said identifier has pre\dously been assigned 
to the source node for that link and that identifier has not previously been assigned to the 
destination node for that link, assigning that identifier to the destination node and any further 
nodes, which are reachable from the destination node by traversing unidirectional links selected 
thus far, to which that identifier has not previously been assigned; 

(d) if step (c) results in assignment to a said selected node of a said identifier not 
previously assigned to that selected node, storing the directional cost of the last-selected 
unidirectional link as the restrictive cost for the directional path to that selected node fi-om the 
selected node to which that identifier was initially assigned in step (a); and 

(e) repeating steps (b) to (d) at least until a restrictive cost has been stored for 
directional paths between predetermined pairs of said selected nodes. 

In another aspect of the invention, methods embodying the present invention provide for 
generation of a restrictive cost set for a group of nodes in a highly efficient manner, allowing 
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asymmetric costs, rather than merely symmetric costs, to be taken into account. Where there is 
more than one path in a given direction between a pair of nodes for which a restrictive cost is 
requdred, then the restrictive cost of the best path will be generated, and restrictive costs can be 
obtained for paths in both directions between a given pair of nodes. 

In another aspect of the invention, where the cost of a link is defined in accordance with 
the convention that the lower the cost, the better the link, then step (a) will select the 
unidirectional links in order of increasing cost to ensure the restrictive costs generated are 
always those of the lowest-cost paths. However, in some embodiments costs could be defined 
differently, ie., the higher the cost the better the link. For example, the "cost" could be directly 
proportional to the parameter, such as bandwidth, by which a Unk is measured, or the cost 
might be that parameter itself. In cases where the costs are defined in such a way, the links wiU 
be selected in order of decreasing cost, and a resulting restrictive cost will be the minimum of 
the costs of the constituent links in the path between the selected nodes. 

In a preferred embodiment, the present invention, the network system is applied to 
comprise a single network or an internetwork, and the group of nodes over which the restrictive 
costs are generated may be an entire network or a subset of the nodes in a particular network 
or internetwork, such as a PNNI peer group for example. The restrictive costs are generated 
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for directional paths between selected nodes of the group. The selected nodes may be border 
nodes of the group so that restrictive costs will be generated for paths traversing the group. 
Applications can be envisaged, however, where the selected nodes are some other subset of 
two or more nodes in the group, or even all nodes in the group. 

The identifier assigned to each selected node is unique in the sense that it is different 
fix)m the identifier assigned to each other selected node. Any suitable identifiers may be used, 
such as colors, markings, flags, numbers, letters and the like. 

In accordance with step (e) of the above method, steps (b) to (d) are repeated at least 
until a restrictive cost has been stored for directional paths between predetermined pairs of said 
selected nodes. It will usually be desirable to obtain the restrictive cost for directional paths 
between aU pairs of selected nodes. Preferred embodiments will find such paths as discussed 
below, and in these preferred embodiments said predetermined pairs of selected nodes are all 
pairs of the selected nodes. Depending on the particular stmcture of the node group, however, 
the restrictive cost for a path between two of the selected nodes may be determined by the 
restrictive costs stored for two other paths. In particular, if the only path between two selected 
nodes, node A and node B, is via a third selected node, node C, then the restrictive cost for 
path A-C is the maximum of the restrictive costs of paths A-B and B-C. Here, once the costs 
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for paths A-B and C-D have been stored, the cost for path A-C is known. Thus, where it is 
desired to know the restrictive costs for directional paths between all pairs of selected nodes, in 
some embodiments said predetermined pairs of selected nodes may be all pairs for which there 
exists a path through the group between the two nodes of the pair which path does not pass 
5 through another selected node. Steps (b) to (d) will then be repeated at least until restrictive 
costs have been stored for directional paths between these pairs of selected nodes. In some 
embodiments of the invention, the method may be implemented in such a way that the iterations 
of steps (b) to (d) cease when restrictive costs have been stored for these node pairs. Other 
embodiments may be implemented in such a way that the iterations cease when a restrictive cost 
10 has been stored for directional paths between all pairs of selected nodes. Other embodiments 
could of course continue the iterations of steps (b) to (d) in any case until all links have been 
selected. 

In accordance with step (c) of the above method, an identifier previously assigned to the 
source node could be assigned to the destination node and said fiuther nodes even if that 
15 identifier has previously been assigned to that destination node. Similarly, the identifier could be 
assigned to aU nodes reachable from the destination node via unidirectional links selected thus 
far, not just those fiirther nodes to which that identifier has not previously been assigned. 
However, to avoid unnecessary processing, it is preferred that the identifier is only assigned to 
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the destination node and said further nodes if that identifier has not previously been assigned to 
that destination node, and then only to said destination node and further nodes. Also, in step (c) 
of preferred embodiments, any identifier previously assigned to the source node and not the 
destination node is assigned to the destination node and said further nodes. In altemative 
embodiments discussed below, however, if the source node is a said selected node in step (c), 
then only the identifier initially assigned to that selected node in step (a) may be assigned to the 
destination node and said further nodes, and not any other identifier which has been assigned to 
the selected node. 

In accordance with another preferred embodiment of the present invention, data 
indicative of the directional costs associated with links may be stored in the system in various 
ways, and the links may selected in order of cost in dependence on this data, for example by 
searching the cost data each time to find the next highest value. In preferred embodiments, 
however, the method includes generating a list of said unidirectional links sorted by order of 
cost. In such embodiments, links may be selected in step (b) by selecting successive entries 
fiom the Ust. 

In another aspect of the instant invention, the restrictive cost set generated by methods 
embodying the invention can be used in different ways according to the nature of the particular 
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network system. For example, the restrictive costs could be used by one or more nodes in the 
group, e.g., border nodes, to select a path for routing a call across the group within a specified 
cost constraint for the call or to minimize the connection cost for the call. In some systems, such 
as PNNI systems for example, data indicative of the restrictive costs may be "advertised" 
outside the group by distributing data indicative of the costs as part of the topology data sent to 
other nodes in the system. In such cases, the cost data could be used for path selection and caU 
routing both by nodes within the group and nodes outside the group. Accordingly, a further 
aspect of the present invention provides a method of distributing topology data in a network 
system including a group of nodes which comprises a plurality of border nodes, each border 
node being connected to another node of the network system outside said group, and in which 
each node in the group is connected by a link to at least one other node in the group, and each 
link has a pair of directional costs associated therewith such that each link can be considered as 
a pair of oppositely-directed, unidirectional links each of which extends from a source node to a 
destination node and has a said directional cost associated therewith, the method comprising: 

generating a set of restrictive costs associated with directional paths between said 
border nodes by a method as described above; and 

transmitting topology data indicative of said set of restrictive costs to at least one node 
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of the network system outside said group. 

Another preferred embodiment of the present invention provides a method of selecting a 
path for routing a call across a group of nodes in a network system wherein the group of nodes 
comprises a plurality of border nodes, each border node being connected to another node of 
the network system outside said group, each node in the group is connected by a link to at least 
one other node in the group, and each link has a pair of directional costs associated therewith 
such that each link can be considered as a pair of oppositely-directed, unidirectional links each 
of which extends from a source node to a destination node and has a said directional cost 
associated therewith, the method comprising: 

generating a set of restrictive costs associated with directional paths between said 
border nodes by a method as described above; and 

selecting a path for routing of the call via a pair of said border nodes in dependence on 
said set of restrictive costs. 

In a general aspect of the present invention, features are described therein with 
reference to a method of the invention, corresponding features may be provided in apparatus 
according to the invention, and vice versa. Thus, for example, a fiirther aspect of the present 
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invention provides apparatus for generating a set of restrictive costs associated with directional 
paths between selected nodes in a group of nodes of a network system wherein each node in 
the group is connected by a link to at least one other node in the group, and each link has a pair 
of directional costs associated therewith such that each link can be considered as a pair of 
oppositely-directed, unidirectional links each of which extends from a source node to a 
destination node and has a said directional cost associated therewith, the apparatus comprising 
memory for storing the restrictive costs, and control logic configured to: 

(a) assign a unique identifier to each of the selected nodes; 

(b) select said unidirectional links in order of cost; 

(c) for each unidirectional link selected, if a said identifier has previously been assigned 
to the source node for that link and that identifier has not previously been assigned to the 
destination node for that link, to assign that identifier to the destination node and any further 
nodes, which are reachable fi-om the destination node by traversing unidirectional links selected 
thus far, to which that identifier has not previously been assigned; 

(d) if step (c) results in assignment to a said selected node of a said identifier not 
previously assigned to that selected node, to store in said memory the directional cost of the 
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last-selected unidirectional link as the restrictive cost for the directional path to that selected 



node from the selected node to which that identifier was initially assigned in step (a); and 



(e) to repeat steps (b) to (d) at least until a restrictive cost has been stored for 



directional paths between predetermined pairs of said selected nodes. 



5 



The invention further provides: a device for connection as a node in a network system 



which device comprises apparatus as described above; and also a network system comprising a 
plurality of nodes at least one of which comprises such a device. 

A still further aspect of the present invention provides a computer program element 
comprising computer program code means which, when loaded in a processor of a device in a 
10 network system comprising a group of nodes, configures the processor to perform a method as 
described above. 

For a better understanding of the present invention, together with other and fiirther 
features and advantages thereof, reference is made to the following description, taken in 
conjunction with the accompanying drawings, and the scope of the invention that will be pointed 
15 out in the appended claims. 

Brief Description of the Drawings 
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Figure 1 illustrates the process of topology abstraction in a PNNI hierarchical network; 

Figure 2 illustrates two different representations of a logical group node in a PNNI 
hierarchical network; 

Figure 3 is a schematic illustration of a network device for implementing methods 
5 embodying the invention; 

Figure 4 is a schematic representation of an edge list used in embodiments of the 
invention; 

Figures 5a and 5b are flow charts illustrating the process of generating a restrictive cost 
matrix in an embodiment of the invention; 

10 Figure 6 illustrates the topology of a sample PNNI peer group for which operation of a 

method embodying the invention will be described; 

Figures 7a to 7g are schematic diagrams illustrating successive stages in operation of the 
cost matrix generation process; and 

Figure 8 illustrates schematically how the resulting cost matrix can be used in a network 
15 system embodying the invention. 
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Detailed Description of the Preferred Embodiment 

In the following, an embodiment of the method for generating a set of restrictive costs 
will be described for the case where the method is applied to generate the restrictive cost 
matrix, or "transition matrix", for a PNNI peer group. Before describing the transition matrix 
generation process, it is useful first to consider PNNI networks in more detail. 

PNNI (Private Network-to-Network Interface) is a hierarchical, dynamic link-state 
routing protocol defined by the ATM (Asynchronous Transfer Mode) Forum for use in ATM 
networks. The hierarchy extension and the use of a single routing protocol at all levels of the 
hierarchy allow the support for large-scale ATM networks. Among the major characteristics of 
the protocol are signaling for switched virtual circuits (SVCs), dynamic routing capabilities, and 
support for quality of service (QoS) parameters. As already mentioned, a key feature of the 
protocol is the ability to cluster network nodes into manageable groups called "peer groups". 
One node in each peer group serves as the peer group leader and represents that peer group as 
a logical group node in the next layer up of the hierarchy. This concept is illustrated 
schematically in Figure 1 of the accompanying drawings. In the figure, a peer group A in PNNI 
layer k consists of four nodes Al, A2, A3 and A4. Three of these nodes, nodes Al, A2 and 
A3, are border nodes. Each border node has a link connecting peer group A to another peer 
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group (not explicitly shown in layer k), here peer groups B, C and D respectively. The 
topology in layer k is abstracted in the next layer up of the hierarchy, ie. layer k+1, such that 
each layer k peer group is represented as a single logical node in layer k+1. Thus peer group A 
is represented by node A in layer k-hl, peer group B is represented by node B in layer k+1, 
and so on. In the figure, nodes A, B, C and D themselves form a peer group in layer k+1. 

ATM is a source routing technology. To enable source route computation and to 
support QoS, the nodes must maintain information about the network topology. PNNI thus 
defines a system for the creation and distribution of topology data within a network. The 
topology data is defined by PNNI Topology State Elements (PTSE's) which are created and 
distributed by nodes so that each node can maintain a topology database which defines its view 
of the network. PTSE's include data defining topology characteristics derived ftom link or node 
state parameters. PTSE's are flooded among nodes in a peer group so that each peer group 
node has the same topology database and thus the same view of the network. In the next level 
up of the hierarchy, however, the peer group topology is abstracted as described above, so that 
only the abstracted topology is seen by nodes sharing a peer group at this level. It is this 
topology abstraction that reduces the resources required to define very large networks. 

Call estabUshment in PNNI consists of two operations: the selection of an optimal path 
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and the setup of the connection state at each point along the path. For accuracy in path 
selection, and to allow cost considerations to be taken into account, PNNI provides a way to 
represent a peer group as a logical group node which has a structure that is more sophisticated 
than a single node. This representation is known as the "complex node representation". The 
complex node representation can be derived in various ways by considering the costs 
associated with links in a peer group. The starting point for deriving a complex node 
representation is the "transition matrix" for the peer group. The transition matrix defines the 
restrictive costs of the optimal (lowest cost) paths across the peer group between pairs of the 
border nodes. The complex node representation will be discussed further below, but it is useful 
first to consider some underlying principles. 

In general, a network can be modeled by an orientated graph in which: 

- a node of the network is referenced as a vertex of the graph; and 

- a link between nodes is referenced as an edge between two vertices of the graph. 

Let G( V, £) be the graph representing the network at a given point in time. Here, V is 
the set of vertices and E the set of directed, or directional, edges. Thus, for aU Vi, v[cj^V, if Vi 
and Vj are connected, the edge v[c3 E, Let Vx and Vy be two vertices of the graph G(V, 
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E). The path — ^^^^^ v lis a sequence of n vertices such that: 



Pn-l = Vy 

The length of a path is the number of edges in the path. If the path does not exist, Px,y = { 0} . 
In this case the path is said not to be feasible. 

Let us now associate a cost with an edge. For an edge ^ g E , such a cost wiU be 
C^e^. j G N . (To be more general one covild consider c{e^^ ^^ ) e , but, since the PNNI 

protocol only allows integer representations, in the following only integer values will be 
considered. It is to be noted, however, that the present invention can be applied to non-integer 
costs). The restrictive cost of a path is the maximum of the costs of the traversed edges. Thus, 
for a feasible path y from Vx to Vy of length n, the restrictive cost will be: 

( V ) = niax |C (e p. , p.^i )} .\ If the path is not feasible then Cr(P^ y) = B- \ 

. J J 

As noted earlier, a pair of directional costs can be associated with a link in a network. 
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each associated with traversing the link in a different direction. Thus, a link can be considered 
as a pair of oppositely-directed, unidirectional links each of which has an associated cost. In 
terms of edges between vertices Vi and vj representing the two nodes connected by a link, the 
unidirectional links correspond to edges e^ ^ and ^ , and the associated directional costs are 



one cost is associated with a link regardless of direction. This synunetric cost C is the 
maximum of the costs for the two directions: 



However, to avoid loss of information it is desirable to allow the costs in the two directions to 
be different or "asymmetric". This of course allows restrictive costs of paths to be asymmetric 
also, so that the cost of traversing the path can be different in the two directions. 

As mentioned earlier, the PNNI protocol authorizes two ways of representing a PNNI 
peer group in a higher layer: as a "simple node"; or as a "complex node". An example of these 
two representations is shown in Figure 2. The simple node representation shows the peer group 
as a single node A having ports PI, P2 and P3 connecting the node to external Unks, i.e., links 
to neighboring peer groups. The simple node representation is simple to constmct and use but 




Where only symmetric costs are considered, then only 
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does not give information about the cost of traversing ttie peer group. The principle of the 
complex node representation is to map the simple node to a representation where: 

- the nucleus 1 is a vertex representing the node itself; 

- the nucleus 1 is comiected via spokes 2 to a set of vertices PI, P2 and P3 each 
representing a port in the simple node representation; and 

- optionally, vertices representing ports can be directiy connected by "exception 
bypasses" 3. 

Note that spokes 2 and exception bypasses 3 are actually normal edges belonging to 
the graph. As noted earlier, the complex node representation is derived from the transition 
matrix for tiie peer group and indicates the cost of traversing the peer group, allowing such costs 
to be taken onto account for path selection and other purposes. The drawback is the increased 
processing complexity involved in generating the complex node representation and using this 
representation when computing routes (since there are more vertices and edges than in the case 
of the simple node representation). The complex node representation can be derived for 
various kinds of costs, and can be derived for both symmetric and asymmetric costs, though 
information is preserved by using asymmetric costs as explained above. Once the transition 
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matrix for a peer group has been generated then the complex node representation can be 
derived in accordance with various known algorithms which need not be discussed in detail 
here. The problem addressed by the embodiment of the invention described below is how to 
generate the transition matrix in an efficient manner using asymmetric costs. In particular, using 
the modeling technique described above, if the peer group is represented by a graph G(V, E) 
having border vertices bo, b^.fcD^, then the object is to generate the set of restrictive 
costs defined by the transition matrix: 

C.K.^) 

c(p ^ ) 0 

— 

Figure 3 is a block diagram illustrating a network device for implementing the transition 
matrix generation process. Li general such a device may be a switch, router, bridge, brouter or 
other network device, though only the main elements of the device are shown in this schematic 
representation. As illustrated, the device 5 comprises a control unit 6, a memory 7 and circuitry 
8 which represents the interfaces (I/Fs) and switching fabric which connect the device with its 
links to neighboring nodes and via which the device communicates with the rest of the network. 
The control unit 6 controls operation of the device generally, and includes control logic which is 
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configured to implement the transition matrix generation process described below. The control 
logic may be implemented in hardware or software, or a combination thereof, and suitable 
implementations will be apparent to those skilled in the art fix)m the following description. In 
particular, the control unit 6 may be implemented by a suitably programmed processor, and the 
memory 7 may be an intemal memoiy of the processor or an external memory associated with 
the processor. Where the matrix generation logic is implemented in software, the program code 
may be supplied separately (as an independent element or an element of the code for a number 
of control functions) for loading in a processor to configure the processor to operate as 
described. 

As indicated schematically in the figure, the memory 7 is used for storage of various 
data used by the matrix generation process embodying the invention. In the present case, this 
data includes a peer group topology database in which details of the peer group of which the 
device is a member are maintained in known manner. This topology data includes details of the 
nodes and links and the directional costs associated with the links. The additional data indicated 
in the figure consists of: an edge list, which is generated fix)m the topology data as described 
further below; the cost matrix for which entries are generated in operation; and various working 
data which comprises data sets >4, S, and Cv, defined below and identifiers Cv which are 
assigned to the border nodes as explained below. 
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Figure 4 is a schematic representation of an edge list generated by the control unit 6 for 
a sample peer group. This lists the edges, or unidirectional links, between pairs of the border 
vertices corresponding to border nodes of the peer group, sorted in order of increasing cost. 
For each entry the source (src) vertex and destination (dst) vertex of the edge are given. This 
5 list is generated by the control unit 6 from the topology data stored in the peer group topology 
database of memory 7 as will be apparent to those skilled in the art. While one particular 
representation of an edge list is shown here, there are of course many ways to represent the 
information contained in such a list. For example, the edge list might be a logically sorted list in 
which the actual entries are not presented in cost order but pointers are used to indicate the cost 
10 order. 

The steps implemented by the control unit 6 in this embodiment to generate the 
transition matrix for a peer group are defined by the algorithm presented below in which the 
following definitions and functions are used. 

Definitions: 

15 E Contains the list of edges sorted by increasing cost. 
A Contains the list of "active" edges. 
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M[.][.] The transition matrix. 

B The set of border vertices. 



Cv The color of border vertex V, Defined for Vc B. 



Cv The set of colors of vertex V. 



Used Functions: 



GetFirstEdge Gets and removes the first edge fix3m the list of edges. 

Src Vertex Retums the source vertex of an edge. 

DstVertex Retums the destination vertex of an edge. 

Getcost Retums the cost of traversing an edge. 

GetNewColor Retums an unused color. 



GetBorderNode Retums the border node that originated a given color. 

The pixDcess begins with the following initialization steps. 

Initialization: 
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Va:?^ y :M[x][y] :=oo; 
yx:M[Mx]y=0, 

VV:C^^{0]; 

We B:C^ y= GetNewColorQ; 

A:={0}; 

The algorithm itself consists of two parts: 
Algorithm, part 1: 

whae {E^{0}) do 

e :=GetFirstEdge(E); 
A :=A u {e}; 
5 :=SrcVertex(e) 
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Z):=DstVertex(e) 

V c G Cs : PropagateColor(Z), c, e); 



done 



Algorithm, part 2 : 
5 PropagateColor( vertex V, color c, edge 
1 if c G Cv then return; end if; 
Cy := Cv u {c}; 
if((yG S)a (Cv^c))then 
:j S -GetBorderNode(c); 

10 M [5] [ V ] := GetCost(e); 

if Vij : M[i]{j] ^ oo then STOP; end if; 

end if, 

V ( e e >A A SicVertex(e)= V ) : PropagateColor(DstVertex(e), c, e); 
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end; 

Figures 5a and 5b are flow charts representing the steps of the algorithm in simplified 
form. Figure 5a corresponds generally to the first part of the algorithm and Figure 5b to the 
second part. Referring first to Figure 5a, the process begins when the transition matrix is to be 
5 generated as indicated by step 10. (This may be, for example, on initial set up of a network or 
when the peer group topology changes through addition or removal of a link or node for 
example. The device 5 which implements the process may be the peer group leader for 
example, or all border nodes, or even all nodes in the peer group, might generate the transition 
matrix independently in some cases.) In step 1 1 the edge list (corresponding to set £" in the 

10 algorithm) is generated and stored in memory 7. The initialization process is also performed in 
this step. This involves setting the initial state of the matrix M such that all entries are ©o except 
for the diagonal entries (M[;c][jc]) which are set to zero. The set of active edges A, and the set 
of colors Cy for each vertex V, are initialized. Further, each of the border vertices is assigned a 
iinique identifier, in this case a "colof' Cv (for V e S ). This color is also added to the set of 

15 colors Cy for each vertex V g B. 

Next, in step 12, the first (lowest cost) edge is selected from the edge list E. This edge 
is thereby removed from the edge list and added to the set A of active edges. Thus, an "active" 
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edge is an edge which has been selected and removed from the edge Ust. The source and 
destination vertices of the selected edge are identified from the edge Ust, and step 13 checks 
whether any colors have been assigned to the source vertex S. If not, (i.e., Cs = { jZ^ }), then 
operation proceeds directly to step 17 discussed below. However, if any colors have been 
assigned to the source vertex (Cs = { JZ^ }), as indicated by a "Yes" at step 13, then in step 14 
the first color in Cs is retrieved as the current color c. Next, in step 15, the "Propagate Color" 
fimction is invoked and operates for the current color c. The Propagate Color function is 
defined by the second part of the algorithm which is represented by Figure 5b. 

Referring to Figure 5b, the Propagate Color function is invoked at step 20 (which 
corresponds to step 15 of Figure 5a as just described). In step 21 the control unit checks 
whether the color c has already been assigned to the destination vertex for the current edge, i.e., 
whether c g Cy for the destination vertex V. If so, then the color need not be propagated again 
and in step 22 operation returns to the step in Figure 5a at which the fiinction was invoked, ie. 
step 15. However, if a "No" is obtained at step 21, then in step 23 the color c is assigned to 
the destination vertex for the edge (Cv := Cv u {c}). Step 24 then checks whether the 
destination vertex is a border vertex to which a new color (i.e., different to the unique color 
initially assigned to that border vertex) has been assigned by step 23. If so, then a path across 
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the peer group has been found and the transition matrix is updated in step 25. Specifically, the 
cost of the last-activated edge (i.e., the edge e last selected in step 12 of Figure 5a) is stored as 
the matrix entry for the path to the current border vertex fix)m the border vertex to which the 
current color c was initially assigned at the initialization stage. This corresponds to step M[5][y 
5 ] := Getcost(e) in the algorithm and will be illustrated further with reference to the example 

described below. Next, step 26 checks whether the matrix is full (i.e., V/j : M[/][/] ^ oo). If so 
the matrix generation process is complete and the operation terminates. If not, operation 
proceeds to step 27. Reverting to step 24, if the destination vertex for the current edge is not a 
border vertex to which a new color has been assigned, steps 25 and 26 are bypassed and 

10 operation proceeds direcdy to step 27. Either way, in step 27 the control unit checks whether 
any further vertices to which the current color c has not already been assigned are reachable 
from the current destination node by traversing (one or more of) any edges activated thus far, 
i.e., edges e e >4. If any such further vertices are found then, for the first of these, operation 
proceeds to step 28 where the current color is assigned to this vertex. Operation then reverts 

15 to step 24. If step 28 has not resulted in a new color being assigned to a border vertex as 
determined in step 24, then the process reverts to step 27 where, for the next of the "further 
vertices", if any, operation again proceeds to step 28. This loop continues until all of the further 
vertices reachable from the original destination node for the last activated edge have been 
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assigned the current color, and no further vertices remain at step 27. In any pass of this loop, 
however, if step 24 detects that a new color has been assigned to a border node, then a new 
path across the peer group has been found and the process will implement steps 25 and 26 to 
update the matrix as before. Once all further vertices have been colored, operation returns from 
step 27 to the step in Figure 5a at which the Propagate Color function was invoked, ie. step 
15. From here, the process continues to step 16 of Figure 5a which tests for any further colors 
in the set Cs for the original source vertex of the last-activated edge. If there are any further 
colors in the set, then operation reverts to step 14 where the next color is retrieved as the 
current color. This will then be propagated by the Propagate Color function in step 15 as 
before. When all colors in Cs have been dealt with in this way, a "No" at step 16 results in 
operation proceeding to step 17. Here, the control unit checks whether the edge list is empty, 
indicating that aU edges have now been activated. If not, operation reverts to step 12 where the 
first edge remaining in the edge list is selected and activated as before. 

The process described above thus continues untD either the transition matrix is 
completed, as indicated by a "Yes" at step 26 of Figure 5b, or until all edges have been 
activated and the edge list is determined to be empty in step 17 of Figure 5a Usually, the 
matrix wiU be completed before all edges have been activated as demonstrated in the example 
below. 
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Figure 6 shows a PNNI peer group consisting of ten nodes, labeled 1 to 10 in the 
figure, three of which are border nodes. The border nodes are nodes 2, 4 and 8 and are 
differentiated by the diamond shapes in the figure. The nodes are interconnected by links as 
shown, and the asymmetric directional costs associated with these links are indicated by the 
numerals shown next to the arrowheads. The edge list of Figure 4 corresponds to this peer 
group. Figures 7a to 7g illustrate schematically successive stages in the matrix generation 
process just described. In each of these figures the state of the transition matrix is shown in the 
top right hand comer. 

Figure 7a iUustrales the stage immediately following the initialization process. Unique 
colors, here red (R), blue (B) and green (G), have been assigned to border nodes 2, 4 and 8 
respectively. No edges have yet been activated as indicated by the absence of links in the 
figure. Figure 7b illustrates the state after edges 1 to 4 from the edge list of Figure 4 have been 
activated. Node 1 has no colors when edge 1 is activated so no color is propagated to node 3. 
However, activation of edge 2 propagates green to node 6, and activation of edges 3 and 4 
propagates green to nodes 7 and 9. 

In Figure 7c edges 1 to 8 have been activated. Activation of edge 5 propagates no 
colors. However, edge 6 propagates green to node 3 and aU further nodes which are reachable 
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from node 3 via edges activated thus far and which are not already colored green. Nodes 6 
and 9 are aheady colored green in this case. Edge 7 propagates no colors, but edge 8 
propagates blue to node 1 and all nodes which are not yet colored blue and which are 
reachable from node 1 via activated edges. Thus nodes 3, 6 and 9 also get colored blue. 

In Figure 7d edges 9 and 10 have been activated. Edge 9 propagates green and blue to 
node 2. Node 2 is a border node and, since two new colors have been assigned to this node, 
two paths across the peer group have been found. These are the paths to node 2 from the 
border nodes to which the new colors were initially assigned, ie. nodes 4 and 8 for colors blue 
and green respectively. Thus restrictive cost entries are made in the matrix for paths P4 2 and 
Ps,! as indicated. In each case the entry is the cost of the last-activated edge, ie. 25 in both 
cases here. 

The colors continue to be propagated as more edges are activated, and each time a 
border node is colored with a new color the cost of the last-activated edge is stored as the 
matrix entry for the appropriate path. In Figure 7e edges 1 to 14 have been activated, edge 1 1 
having propagated blue to border node 8 giving M[4][8] as 30. In Figure 7f edge 15 
propagates red to nodes 7, 3, 6, 9 and 8 giving M[2][8] as 40. In Figure 7g, nodes 1 to 19 
have been activated and edge 19 has propagated red and green to node 4. Thus A/[2][4] and 
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M[8][4] are 50 and the transition matrix is full. The process therefore terminates (step 26 of 
Figure 5b). Not all edges have been activated and not all vertices have been colored. 

Note that, in the above process, processing is reduced by only propagating a color from 
a first node to a second node if that color has not already been assigned to the second node 

5 (This is a consequence of the step "if c e Cv then retum" in part 2 of the algorithm which 

corresponds to steps 21 and 22 in Figure 5b and also restricts the nodes considered in step 27 
of Figure 5b). Also, in this embodiment the process will find and store matrix entries for the 
restrictive costs of directional paths between all pairs of the border nodes. Even if the peer 
group is such that the only path between two border nodes, say nodes A and C, is via another 

10 border node B, then the cost of path A-C will be found as for any other path. However, the 

control logic could be configured to detect such a situation, automatically storing the matrix entry 
for path A-C (as the maximum of the entries for paths A-B and B-C) immediately the second of 
the two constituent paths is found. This could be achieved by inserting an additional step in the 
algorithm to check for this so-called "transitivity", and may result in the process terminating 

15 slighdy faster in some cases. For example, the following step checking for transitivity could be 
inserted after the step M[5][V ] := GetCost(^) in the second part of the algorithm: 

if (VZ? G B): (Z> ^ 5) A (Z? ^ V) A (M[SM = oo) a (M[VM ^ co) then M[S,b]:= GetCost(^); end 
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if, 

In other embodiments, the process may be modified such that only "direct" paths between a 
pair of border nodes (ie. paths which do not pass through another border node) are detected. 
This could be achieved, for example, by modifying the algorithm such that, once a new color has 

5 been propagated out to a border node, that color is not propagated back in again. That is, if 
the source node of an edge is a border node, only the color initially assigned to that border node 
is propagated and not any other colors assigned subsequendy to that border node. Here, if the 
only path between two border nodes is via another border node, this path would not be 
detected by the process, and the process would not terminate until all edges had been activated. 

10 This does not matter, however, since the appropriate matrix entry for such a path is the 

maximum of the cost entries for the two constituent paths and is therefore determined by the 
process in any case. Again, however, in such embodiments the control logic could be 
configured to automatically store the matrix entry for such a path when the costs for the two 
constituent paths have been obtained. The process could then terminate in dependence on 

15 whether the matrix is complete as above. Altematively in such embodiments, the logic might 
simply terminate the process when the cost entries for all the paths which do not pass through 
another border node have been found since all required costs are then known. In any case, 
since it wiU usually be desired to know the restrictive cost for all matrix entries, it wiQ be seen 
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that the process should be designed to continue at least until the restrictive cost has been stored 
for directional paths between aU pairs of border nodes for which there exists a path that does 
not pass through another border node. 

It will be seen that the above provides a highly efficient system for generating the 
transition matrix for a peer group. The complexity of the algorithm employed is 0(me), where 
m here is the number of border nodes and e the number of edges. This is significantly more 
efficient than algorithms such as the Floyd- Warshall and Johnson's algorithms mentioned earlier, 
particularly as in general m « n. The resulting transition matrix may be used for various 
purposes as indicated for example by the schematic flow chart of Figure 8. Once the transition 
matrix is obtained at step 30, the complex node representation (CNR) for the peer group can 
be derived as indicated at step 31. The CNR can be generated by the control unit 6 of the 
network device 5 in known manner, and the CNR-generation process need not be discussed 
here. Data defining the complex node representation can then be transmitted to neighboring 
nodes in the PNNI peer group in the next hierarchy level via the usual process for advertising 
topology data, as indicated by step 32. This data can then be used by network nodes for path 
selection and routing purposes as indicated by step 33, whereby the costs associated with 
traversing the peer group can be taken into account in these processes. 
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Although certain preferred embodiments of this invention have been described in detail 
with reference to the accompanying drawings, those skilled in the art should appreciate that the 
various changes and modifications may be made therein without departing from the spirit and 
scope of this invention. For example, while the method described above is appUed to generate 
the transition matrix for a PNNI peer group, embodiments of the invention can be applied to 
determine restrictive costs for directional paths between selected nodes in other node groups 
and in other network systems. A further example is an IP/OSPF (Intemet Protocol/Open 
Shortest Path First) network. Here, again, topology data is abstracted such that outside a given 
routing domain only reachable addresses, rather than link/node topology, are available. At 
present, the OSPF protocol does not involve considerations of restrictive cost, but there are 
proposals to incorporate such considerations for costs dependent on bandwidth in particular, 
and embodiments of the invention could be applied to advantage in such systems. 
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